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Abstract 

The paper is devoted to the problem of establishing right-convergence of sparse random 
graphs. This concerns the convergence of the logarithm of number of homomorphisms from 
graphs or hyper-graphs Gn,N > 1 to some target graph W. The theory of dense graph con- 
vergence, including random dense graphs, is now well understood [BCL+08] , [BCL+| , [LS06] , [CVllj , 



but its counterpart for sparse random graphs presents some fundamental difficulties. Phrased 
in the statistical physics terminology, the issue is the existence of the log-partition function 
limits, also known as free energy limits, appropriately normalized for the Gibbs distribution 
associated with W. In this paper we prove that the sequence of sparse Erdos-Renyi graphs 
is right-converging when the tensor product associated with the target graph W satisfies 
certain convexity property. We treat the case of discrete and continuous target graphs W. 
The latter case allows us to prove a special case of Talagrand's recent conjecture (more ac- 
curately stated as level III Research Problem 6.7.2 in his recent book [TallO j). concerning 
the existence of the limit of the measure of a set obtained from M> N by intersecting it with 
linearly in iV many subsets, generated according to some common probability law. 

Our proof is based on the interpolation technique, introduced first by Guerra and 
Toninelli [FF02] and developed further in [FL03] . |FLT03| . |PTf)4| . |Mon05| . [BGTiOj . 
|AM] . |CDGS| . Specifically, [BGT1J]] establishes the right-convergence property for Erdos- 
Renyi graphs for some special cases of W. In this paper most of the results in [B GT10] 
follow special case of our main theorem. 



1 Introduction 

Given two graphs G and W, a graph homomorphism is a mapping from the nodes of G to the 
nodes of W, such that every edge in G is mapped onto an edge in W. When nodes and edges of 
W are weighted, the homomorphism inherits a certain weight itself (see Section |2] for details). A 
sequence of iV-node graphs Gat, iV > 1 is defined to be right-converging with respect to W if the 
logarithm of the sum of homomorphisms weights, normalized by N, has a limit. In the statistical 
physics terminology, the nodes of W correspond to spin values, and the sum of homomorphism 
weights is called the partition function. 
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The theory of graph convergence is now well developed for the case of dense graphs (graphs 
with number of edges of the order 0(N 2 )), see |BCL+08j . |BCL+j . [LS06] . jUVllj . where the nor- 
malization is appropriately iV 2 , not N. The theory of sparse graphs convergence, however, 
presents some challenges [BR11] . [BCLK] . as even establishing some of the basic properties of 
convergence for sparse graphs remain conjectures at best. For example, it is an open problem 
to show that the most basic sequence of sparse random graphs, namely the sequence of sparse 
Erdos-Renyi graphs is right- converging with respect to every target graph W. 

In this paper we prove a special case of this conjecture, under the assumption that a cer- 
tain tensor product associated with the target graph W satisfies some convexity property. Our 
additional technical assumption is the existence of spin values (labels of W) with positive inter- 
action with every other spin value (namely the corresponding edge weights are positive). This 
assumption is adopted in order to avoid potentially nullifying the partition function. See [AMJ 
where a similar issue is treated instead by conditioning for partition function to stay positive. 
We formulate the problem of right- convergence both for the case of discrete and continuous spin 
values, the latter corresponding to the case when the nodes of W are indexed by real values and 
node and edge weights are random quantities described by some random measurable functions. 
Our framework is rich enough to accommodate a recent conjecture by Talagrand regarding the 
existence of the limit of a measure of the set obtained from M. N by intersecting it with subsets 
of WL N , chosen i.i.d. according to some common probability law, see Section [3] for the precise 
statement. More accurately stated as Research Problem 6.7.2 in his recent book [TallOj . this is 
one of the many fascinating so-called Level III problems in the book. 

Our method of proof is based on the interpolation technique introduced by Guerra and 
Toninelli [FF02] in the context of Sherrington-Kirkpatrick model in statistical physics and fur- 
ther developed for the case of sparse graphs (called diluted spin glass models in the statistical 
physics literature) by Franz and Leone |FL03j . [FLT03] . Panchenko and Talagrand |PT04j . Mon- 
tanari |Mon05j . Bayati et al |BGT10j . Abbe and Montanari |AMj . The idea is to build a sequence 
of graphs interpolating between a random graph on N nodes, on the one hand, and a disjoint 
union of two random graphs with and nodes on the other hand, where N\ + N2 = N. The 
interpolation is constructed in such a way that in every step of the interpolation the log-partition 
function increases or decreases in expectation (depending on a model). Such a property means 
that the expected log-partition function is sub- or super-additive, thus implying the existence of 
the limit vis-a-vi the Fekete's lemma. The convergence with high probability requires an addi- 
tional concentration type argument, which for our case turns out to be more involved than usual, 
due to the continuity of spin values. We show that the super-additivity property holds for the 
class of models of interest when the assumptions of our main theorem hold. We further verify 
the assumptions for a broad scope of models considered earlier in the literature. In particular, 
most of the results obtained in |BGT10j . including those regarding Independents Set, Partial 
Coloring, Ising and random K-SAT models, follow from the main result of the present paper as 
a special case. As mentioned above, we do suspect that the right-convergence holds for sparse 
Erdos-Renyi graphs for all target graphs W and state this explicitly as a conjecture, since, at 
the present time we do not have a single counterexample, however contrived. 

The remainder of the paper is structured as follows. The notions of graph homomorphisms 
and right-convergence are introduced in the following section. Many examples are discussed also 
in the same section. Finally, the section introduces the definition of graph homomorphism for 
continuous spin values. While continuous spin models are ubiquitous in the physics literature, 
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they are rarely discussed in the context of graph theory. Our model assumptions, conjectures and 
our main result are stated in Section |3j In the same section we provide an in depth discussion 
of the convexity of tensor products property - the principal technical tool underlying our main 
result, and discuss its relevance for examples introduced earlier in Section El In Section @] we 
establish some basic properties of the log-partition functions and establish a concentration result. 
The interpolation technique is introduced in Section [5] and the proof of our main result is found 
in the same section. 

We finish this section by introducing some notations. e d = (1,1,..., 1) T denotes a d- 
dimensional vector of ones. 1{A) is an indicator function, taking value 1 when the event A 
takes place and zero otherwise. Throughout the paper we will use standard order of magnitude 
notations O(-) and o(- • • ) where the constants hidden O should be clear from the context. K 
denotes the set of real (non-negative real) values. 

2 Graph homomorphisms and right-convergence 

Consider a ^-uniform directed hypergraph G on nodes {1,2, . . . , N} = V(G). Let E(G) be 
the set of hyperedges of G, each hyperedge e = {u\, . . . , u e K ) G E{G) being an ordered sets of K 
nodes in G. We fix a positive integer q and refer to integers 0, 1, . . . , q — 1 as colors or spin values, 
interchangeably. For every node u G V{G) of the hypergraph, let N(u, G) be the set of edges 
incident to u. Then \Af(u, G)| is the degree of u in G, namely the total number of hyperedges 
containing u. Similarly, for hyperevery edge e, let Af(e, G) be the set of hyperedges incident to 
e, including e. Namely, M{e, G) is the set of hyperedges sharing at least one node with e. For 
simplicity, from this point on we will use the terms graphs and edges in place of hypergraphs 
and hyperedges. 

Each node u G V(G) of G is associated with a random map h u : {0, 1, . . . , q— 1} — > M + called 
node u potential. The sequence h u ,u G V{G) is assumed to be i.i.d. distributed according to 
some probability measure Vh. Similarly, each hyperedge e G E(G) is associated with a random 
map J e : {0,1,..., q— 1} K — > IR+ called hyperedge e potential. The sequence J e ,e G E(G) 
is i.i.d. as well with a common probability measure vj. Further details concerning probability 
measures and vj will be discussed later. For many special cases it will be assume that these 
measures are singletons. Namely, the maps h u and J e are deterministic. 

Given an arbitrary map a : V(G) — > {0, . . . , q — 1}, we associate with it a (random) weight 

H{v)= J] II U«),...,a{u e K )). (1) 

ueV(G) ee£(G) 

Any such map is called homomorphism for reasons explained below. The following random 
variable is defined to be the partition function of G: 

Z(G)^H(a), (2) 

where the sum is taken over all maps a : V{G) — > {0, . . . , q — 1}. We note that the value 
Z{G) = is possible according to this definition. In case Z(G) > 0, this induces a random Gibbs 
probability measure on the set of maps a, where the probability mass of a is H(a)/Z(G). The 
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graph G with potentials h u , J e and the corresponding Gibbs measure is also commonly called 
Markov Random Field in the Electrical Engineering literature. 

Already a very rich class of models is obtained when the potentials h u and J e are deterministic, 
denoted by h and J for simplicity. Consider, for example a special case h — 1. Further, suppose 
K = 2 and J is a symmetric zero-one valued function in its two arguments. Consider an 
undirected graph W on nodes 0, . . . , q — 1, where is an edge in W if and only if J(i,j) = 1 
(the symmetry of J makes the definition consistent). Then observe that H(cr) = 1 if a defines 
a graph homomorphism from G to W and H(a) = otherwise. (Recall that given two graphs 
Gi, G2, a map a : V(Gi) —> V(G2) is called graph homomorphism if for every (11,12) G E(Gi) we 
have (a(ii), (7(12)) G E(&2))- Thus Z(G) is the number of homomorphisms from G to W . In that 
sense we can think of an arbitrary map a : V(G) — > {0, 1, . . . , q — 1} as a graph homomorphism 
and the associated partition function Z(G) is the "number" of homomorphisms. 

Let us discuss some well-known examples from combinatorics and statistical physics in the 
context of our definition. 

2.1 Examples 

Independent Sets (Hard-Core) model. A parameter A > is fixed. K = 2, q = 2. The 

node and edge potentials are deterministic denoted by h and J respectively. In particular, we 
set h(l) = A and h(0) = 1. The edge potential is defined by J (11,12) — if ii — 12 — 1 and 
J(ii,i2) — 1, < 11,12 < 1, otherwise. Then H(a) > if the set of nodes u with cr(u) = 1 is 
an independent set in G, and H(a) = otherwise. Moreover, in the former case H(a) = X k , 
where k is the cardinality of the corresponding independent set. Thus Z(G) is the usual partition 
function associated with the independent set model, also known as the hard-core gas model. The 
parameter A is commonly called activity or fugacity. When A = 1, Z(G) is simply the number 
of independent sets in the graph G. 

Partial Colorings (Potts) model. K — 2, h u — h = 1. A parameter (5 > is fixed. The edge 
potentials are identical for all edges and given by J(ii, 12) = 1 if ii 7^ ?2 and = exp(— pi) otherwise. 
In this case H(o) = exp(— pk), where k is the number of monochromatic edges, namely edges 
receiving the same color at the incident vertices. The case P > (P < 0) is usually called anti- 
ferromagnetic (ferromagnetic) Potts model. In this paper we focus on the anti-ferromagnetic 
case. 

Ising model. K — 2, q — 2. h u (l) = h(l) = h, for some constant value h G R, and h u (0) = 
h(0) = 1. The edge potentials are identical for all edges and given by J(ii,i2) = exp(— pi(i\ 7^ 
i 2 ) + Pl(ii = 12)), for some parameter p. As for the coloring model, the case P > (P < 0) 
is called ferromagnetic (anti-ferromagnetic) Ising model. Parameter h is called the external 
magnetization. It is more common to consider {—1, 1} as opposed to {0, 1} as a spin value 
space, in which case we can simply write J(ii,i2) = exp(/3iii 2 )- When h — 1, it is easy to see 
that the Ising model is equivalent to a special case of the Potts model when q = 2, by multiplying 
each H(a) by a constant factor. 

Viana-Bray model, q — 2. h(l) = h > 0, for some constant value h, and h(0) = 1. A random 
variable /, which is symmetric around zero and has bounded support, and parameter P > are 
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fixed. Let J(ii, ■ ■ ■ ,ijc) — exp (PI YIki<k(^-(^i = -0 — = 0)))- A more common approach 
is to fix the set of colors to be { — 1, 1}, in which case J{i\, . . . ,1k) = exp (PIYIkkk^ 1 )' The 
assumption of bounded support is not standard, but is adopted in this paper for convenience. 

XOR Model. Consider the Viana-Bray model with h = 1 and I taking values 1 and —1 with 
equal probability. For convenience let us assume that the spin values are —1 and 1 as opposed to 

and 1. When 1 = 1, the potential J{i\, . . . , %k) takes value exp(/3) if an only if an even number 
of iki 1 < k < K is —1, and otherwise it takes value exp(— 0). The situation is reversed when 

1 = — 1. A more common definition of the XOR model is as follows: J(i\, . . . , ir) = (I + h ■ • • ix) 
mod (2). Namely J = when the parity of the product i\ - • -%k coincides with the parity of 
/, and J = 1 otherwise. Thus the model involves hard-core interaction (namely allows J to be 
zero). In this case the corresponding partition function Z(G) is the number of valid assignments, 
namely assignments such that every edge potential value is equal to unity. This version of the 
model is outside of the scope of this paper, but we do notice that we obtain it from our version by 
defining J(i\, . . . , %k) = exp (— (3 + (31 YIkkk *0 instead, and sending (3 to +oo. The conditions 
for existence of valid assignments and the number of valid assignments has been a subject of 
study on its own |MM09] . [A~M] . |IKKM] . 

Random K-SAT model. This is our first example for which considering order of nodes in the 
edges e = (wf , . . . , u e K ) is relevant. We set q = 2. h u = h = 1 for all u. For every edge e a vector 
(z*, . . . , i* K ) is selected uniformly at random from {0,1}^. We define 



J e (ii, ...,1k) 



1, {i x , . . . ,i K ) ^ ■ ■ ■ ,i* K ) \ 

exp(-/3), (ix,...,i K ) = (z*, . . . , i* K ). 



Again a more common version of this model is to defined J e {ii, • • • , ik) to be when . . . , zk) = 
(i*, . . . ,i* K ) and 1 otherwise. Z(G) is the number of satisfiable assignments. As for the Viana- 
Bray model we can think of this model as a limit as (3 — » oo. 



2.2 Continuous spin values 

We now generalize the notion of graph homomorphisms to the case of real valued colors (spins). 
This is achieved by making h and J random measurable functions with real valued inputs. 
Specifically, assume that we have random i.i.d. (Lebesgue) measurable function h u : R — > 
K+, u G V(G), and random i.i.d. (Lebesgue) measurable functions J e : R K — > R + , e G E(G). 
The probability measures corresponding to the randomness in choices of h u and J e are again 
denoted by and vj, respectively. Every homomorphism, which now is assumed to be any map 
a : V(G) — > JR., is associated with a weight defined as 

H{o)= J] h uHu)) J] J e {a{ul),...,a{u K )), 

ueV(G) eeE(G) 

and the associated partition function is defined as the following integral taken in the Lebesgue 
sense: 

Z(G) = [ H{a)da. 
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A more conventional way to write the partition function is to think of (o~(u),u G V(G)) as an 
N = |K(G) (-dimensional real vector (x u ,u G V(G)) = (x±, . . . ,x^), thus defining the associated 
partition function 

Z(G)= [ j h u {x u ) J [ J e (x u e,...,x u e K )dx. 

Jx=(xi ,...,X/v)eM JV 1 ^..^ i\r _-m/,r^ 



l<u<N eeE(G) 



We adopt this notational convention from this point on. It is simple to see that the discrete case 
is a special case of the continuous spin value model. Indeed given a discrete model corresponding 
to some K, q and realizations of h u , J e , define for every x G K. 

hf \_(h u (i), if x G [i,i + 1), for i = 0, 1, ...,q- 1; ( , 
au{X> ~ \ 0, otherwise. {6) 

Similarly, J e (xi, . . . , Xk) = J e (H, ■ ■ ■ , ix) if x n G [ii, ii + l),l — 1, . . . , K, and J e = otherwise. 
Then f H(x)dx = J2 a H(a), with the appropriate meaning of x and a in two expressions. 



2.3 Right-convergence of graph sequences 

We will be interested primarily in the case of sequences of sparse graphs G, which for the purposes 
of this paper we define as a sequence of graphs (Gn, N > 1) such that supjy ^(Ga^I/I^Gat)! < 
oo. Namely, the number of edges grows at most linearly in the number of nodes. For simplicity 
we assume from now on that |V(Gat)| = N and V(Gn) = {1,...,N}. The right- convergence 
of graph sequences concerns the existence of the limit of the normalized log-partition function 
iV" 1 logZ(G A r). Here logZ(GAr) is defined to be — oo in the case Z(Gjv) = 0. The following 
definition applies to both the discrete and continuous spin value cases. 

Definition 1. Given probability measures Vh,vj, a sequence of graphs (Gat) is defined to be 
right-converging with respect to u h and uj if the sequence limjv^oo iV -1 log Z(Gjq) converges in 
distribution to some random variable Z in probability. The sequence of graphs is defined to be 
right- converging if it is right- converging with respect to every v h ,vj. 

In many of the interesting cases, included the case considered in this paper, the random 
variable iV -1 log Z(Gn) will be concentrated around its mean E[iV _1 log Z(Gn)], in which case 
the right-convergence is equivalent to the existence of a deterministic quantity z such that 

lim lim P(|AT- 1 logZ(G A r) - z\ > e) = 0. 

e4.0 N-^oo 

It is easy to construct examples of trivially converging graph sequences. For example suppose 
E(G N ) = 0. Then 

Z(G N ) ] [ / h u (x)dx, 
u Jxm 

implying that iV -1 logZ(Gjv) is an average of i.i.d. sequence of random variables distributed as 
log f x( - R h u (x)dx. The limit equals Elog J h u (x)dx, if this expectation is finite, or is some sort of 
a stable law otherwise. In general, it is easy to see that if Gn is a disjoint union of N/k identical 
graphs with k nodes, where k is constant, then Gat is right-converging. 
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The notion of right-convergence comes in contrast to the notion of left-convergence [BSOlj . 
which is roughly defined as convergence of constant depth neighborhoods of randomly uniformly 
chosen nodes in Gat. We do not provide a formal definition of left-convergence since we will 
not be working with this notion in this paper. It is known that right- convergence implies left- 
convergence [BCLK] . but very simple examples exist showing that converse is not true (see 
again |BULKj ). 

In this paper we are interested in right-convergence of sequences of random graphs. A se- 
quence of random graphs G^,N > 1 is defined to be right- convergent, if sequence of graph is 
right-converging in probability with respect to the randomness associated both with the graph 
and potentials h u , J e . In this paper we consider exclusively the following sequence of sparse 
random graphs on N nodes, also known as (sparse) Erdos-Renyi graph, denoted by G(N,c). 
A constant c > is fixed. For each j = 1,2,..., [cN\ the j-th edge is an ordered K tuple 
e j = i u x ■> ■ ■ ■ > u k) chosen uniformly at random from the set of nodes 1,2, ... ,N, repetition al- 
lowed. It is not hard to show that the graph sequence G(N,c),N > 1 is right-converging when 
c < 1/K, as in this case the graph breaks down into a disjoint union of linearly many graphs 
with a constant average size [Bol85j,[JLR00j. A far more interesting case is when c > 1/K, as 
in this case a giant (linear) size connected component exists and understanding the limit of the 
log-partition function in this regime is far from trivial. 

3 Conjectures and the main result 

3.1 Assumptions and main results 

Our main goal is establishing the conditions under which the sequence of Erdos-Renyi graphs is 
right-converging. Since there is no particular reason as to why there should exist any measures 
Vh, Vj and any c > such that G(N, c) would not be right-converging with respect to Vh,vj, and 
since at the very least no counterexamples are known to the day, the following conjecture seems 
plausible. 

Conjecture 1. For every c > 0, the random graph sequence G(N,c) is right- converging. 

Now we turn to the Talagrand's Problem 6.7.2 in |TallOj . mentioned above. Framed in our 
terminology, it corresponds to the special case of Erdos-Renyi graph convergence when J takes 
only values and 1 and h corresponds to a Gaussian Kernel. There are compelling reasons 
to consider even this special case and the details can be found in the aforementioned book. 
Furthermore, it is over interest to consider even more restricted case when the sets defined by 
J = 1 condition are convex. Since the motivation behind the latter assumption is beyond the 
scope of the present paper, we will not focus on it here. 

The precise statement of Talagrand's conjecture is as follows. 

Conjecture 2 (Research Problem 6.7.2 in [TallO] ). For every c > 0, the random graph sequence 
G(N,c) is right- converging when h(x) = exp(— x 2 ) and J G {0, 1}. 

Despite the Gaussian distribution suggested by the kernel h(x) = exp(— x 2 ), one should be 
aware of the fact that we are dealing here with the case of a deterministic node potential. In 
fact, all of our previous examples also correspond to deterministic node potentials as well. The 
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author is not aware of interesting models with genuinely random node potentials studied in the 
past, but since the techniques of the present paper easily extend to the case of random node 
potentials, they are allowed in our model. 

We now turn to assumptions needed for the statement and the proof of our main result. 

Assumption 1. There exist values k > 0,p max > p min > 0, < J max < p max and Q h C M. such 
that 

1. [0, k] C Qh, and, almost surely with respect to Vh, h(x) = for all x Qh- Namely, the 
support of h lies in Qh almost surely. Furthermore, 



Pmin < / h(x)dx < / h(x)dx < p max (4) 

almost surely. 

2. sup^gjg J(x) < J max almost surely. 

3. For every i = 1,2, ... ,K almost surely 

{x G 1R X : Xi G [0, k), x k G tt h , 1 < k < K} C {x G R K : J(x) > p min }. 

The last assumption means that there is a positive measure set of spin values which have 
a positive interaction with every other spin value choices within Q^. In the statistical physics 
terminology this means that continuous spin values in [0, k) have a positive ("soft") interaction 
with all other spin values. 

Let us now verify that Assumption CD holds for all models discussed in Subsection 13.21 For all 
of these models we take Qh = [0, q — 1]. Namely, it is the range of continuous representation of 
the discrete set of colors 0, 1, . . . , q — 1. For the case of Independent Set model the parts 1) and 

2) are verified by taking n = l,p mm = min(A, l),p max = 1 + A, and J max = 1. The assumption 

3) concerning the soft core interaction is verified as well since J takes value 1 as long as at least 
one of the arguments of J belongs to [0, 1]. 

The Assumption [1] is verified in a straightforward way for Partial Coloring and Ising models, 
as in this case J > exp(— /3) > for any choice of spin values. We set k = q — 1 so that all values 
in the domain Q "qualify" for soft-core interaction. We set p max = max(max(l, h)q), J max = 
exp(|/3|), and p m i n = min(min(l, h), exp(— \(3\). For the Viana-Bray model we set J max = p max = 
max(/i, exp(/3c/)), where [— cj,cj] is the support of /. The remaining parts of the assumptions 
for the Viana-Bray and verification of the assumptions for XOR is similar. For the K-SAT model 
we set J max = 1, and 

^ — Pmax — 2, p m in — exp {—(3). It is easy to check that Assumption [1] is 

verified. 

In general it is easy to see that for discrete deterministic models, the only non-trivial part of 
Assumption [T] is the existence of a state with soft interactions. Namely, the existence of a state 
go G {0, 1, . . . , q — 1} such that for every k = 1, . . . , K and every i 1} . . . , i K G {0, 1, . . . , q — 1} 
such that ik = q , we have J(i±, . . . , %k) > 0. In this case we can take 

J max = max J(ii,...i K ), (5) 

0<ii,...,i_ff <<J— 1 

Pmax = max ( J max , q max h(i) J . (6) 



p min = min min J{i u . . . , i K ). (7) 

l<k<K ii,...,i K :i k =qo 
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We now turn to our next key assumption regarding the convexity property of the edge poten- 
tials J e . For this purpose we need to resort to the notions of multidimensional arrays and their 
tensor products. An n-dimensional array A of K-th order is ordered set of real values of the form 
A = (ai l7 ...,i K , 1 < iii ■ ■ ■ i < n). For example, arrays of order 2 are just n by n matrices. A ten- 
sor product of two arrays A = (a>i u ...,i K ) and B = (6^,...,^), of the same dimension n and order K 
is an n 2 dimensional array of order K denoted by A®B, where for each (i^i, ■ ■ ■ , (h,K, H,k) 
the corresponding entry of A <g) B is a ix ^...^ K bi 2 .i,...,i 2 k- Given a convex set 5* C IR n , an array A 
is defined to be convex over S if the following multilinear form defined on y = (yi, . . . ,y n ) G S 
is convex: 

(yi,...,y n )-> 

l<ii,...,ili <n 

When S = M. we simply say the array is convex. For example, the second order array is convex 
if and only if it is positive semi-definite. On the other hand, consider a one-dimensional array 
of order K = 3, which is defined by a single number a > 0. The corresponding multilinear form 
is just y — > ay 3 is convex over Q = K + but is not convex over Q — R. This observation will be 
useful in our analysis of the random K-SAT problem when K is odd. We write (y, A) for the 
expression on the right-hand side of OH]) for short. We now state our main result. 

Theorem 1. Suppose the Assumption [J\ holds. Suppose further that there exists constant a > 
Jmux such that for every X\, . . . , x r £ fiJJ the expected tensor product 

E (g) Ai (9) 

l<Kr 

is convex on the set MJ£ , where Ai is an n-dimensional array of order K defined by 

Ai = a - J = (a - J(x l h , . . .,x[ K ), 1 < i x , . . . , i K < n) . 
Then the graph sequence G(N,c) is right- converging with respect to Vhi v J- 

We note that the tensor product &) 1<l<r A\ is an n r -dimensional array of order K, the same 
copy of random J, generated according to vj is used in this tensor product, and the expectation 
is with respect to the randomness of J. The expectation operator when applied to arrays is 
understood componentwise. 

As we will show in the next section, Theorem [T] covers many special cases, some of them 
already covered in the literature. In particular, the right-convergence for K-SAT and Viana- 
Bray models was established in |FL03] , and the right-convergence for Independent Set, Ising and 
Coloring models was established in |BGT10j . The right-convergence for the K-SAT and XOR 
model with hard-core interaction was established in [AMj . but is not covered by our theorem, 
since the part 3 of Assumption [1] fails for this model. 

3.2 Examples and special cases 

Let us verify that the convexity assumption of Theorem [T] holds for many examples, including 
our examples in Subsection 12.11 For most of the example we will be able to verify convexity 
of the expected tensor product (Q on the entire R" r as opposed to M" r . In particular, let us 
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now focus on discrete models with q spin values. Observe that we can bypass the embedding 
of the discrete model into a continuous model via ([3]). Furthermore, regarding the special case 
when K = 2 and J is deterministic, it is well-known that the product of positive semi-definite 
matrices is positive semi-definite. Thus it suffices to assert the convexity of each individual 
matrix a — J(xi,Xj),x = (xx, . . . ,x n ) G M n , rather than their tensor product. Finally, since Xi 
take arbitrary values in 0, 1, . . . , q— 1, it suffices to simply verify the convexity of the q x q matrix 
(a — J(i,j), < i, j < q — 1). Recall our earlier observation that Assumption [1] holds in this case 
if there exists i such that J(io,j) > for all j, namely maxjmin,, J(i,j) > 0. In this case J max 
can be set as ((5]). We obtain the following result. 

Theorem 2. Suppose K = 2 and J is a deterministic edge potential such that maxj min.,- J(i, j) > 
and the matrix (a — J(i,j), 1 < i, j < q — 1) is positive semi-definite for some a > J max; where 
Jmax is defined by (TJ]]. Then the sequence G(N, c) is right-converging. 

Let us apply this result to our examples, beginning with the Independent Set model. The 
matrix a — J is 

fa — 1 a — 1 \ 
V ct — 1 a J ' 

which is positive semi-definite. For the case of the Partial Coloring model we obtain that a — J 
is a matrix with diagonal entries a — exp(— /3) and off-diagonal entries a — 1 < a — exp(— 0). This 
matrix is positive semi-definite since /3 > (anti-ferromagnetism assumption). The situation for 
the anti-ferromagnetic Ising model is the same, since the only difference is the possible presence 
of the magnetic field. 

Before we turn to other examples, we ask the following question: under what conditions the 
required a can be found for discrete models? While we do not have the answer for the general 
case, the answer for the case of symmetric deterministic positive definite matrices is rather simple 
(the author wishes to thank Laszlo Lovasz for this observation). 

Lemma 1. Suppose J = {Ji.j, 1 < i, j ; < n) is a deterministic, symmetric n x n matrix. There 
exists a>o > such that a — J is positive definite for all a > cto if and only if —J is positive 
definite on the linear subspace 

Ro 4 {y e W 1 : e T n y = 0}. (10) 

Namely y T (—J)y > for every nonzero y G Ro. 

We obtain the following result. 

Theorem 3. Suppose J is a deterministic matrix such that — J is positive definite on Rq and 
maXjHiinj J(i,j) > 0. Then the random graph sequence G(N,c) is right- converging. 

Proof of LemmaU} Suppose a — J is positive definite for some a > 0. Fix any non-zero y G Rq 
and observe that 

< y T (a - J)y = ay T {e n e r n )y - y T Jy = a(e^yf - y T Jy = -y T Jy, 
implying that — J is positive definite on Rq. 
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Conversely, suppose — J is positive definite on R . Fix any sequence a r — > oo. Let 



y r = arg min y (a r - J)y = arg min a r (e n y) -y Jy. 
"~ \\yh=i yeK n ,lls/||2=i 



Such y r clearly exists by the compactness argument. Find y*, \\y*\\2 = 1 such that y r converges 
to y* along some subsequence ri, I > 1. If e T y* = then y* G Ro, giving -(y*) T Jy* > 0. Then 
we can find large enough r, such that mm ye ^n t \\ y \\ 2= i a r (e^y) 2 — y 7 Jy > and the assertion is 
proven. 

On the other hand, if e T y* ^ 0, then we find ro large enough so that a r (e 7 y*) 2 — (y*) T Jy* > 
for all r > r . Then since y n — > y, we can find r; large enough so that min 2/gR ni| 2/ || 2=1 a ri (e 7 y) 2 — 



y Jy > and the assertion is established. □ 

Interestingly, the definiteness condition in Lemma Q] cannot be relaxed to the case when — J 
is positive semi-definite. Indeed let 



J 



-1 
1 



Then y T (—J)y = —y\ + y\ which is when 2/1+2/2 = 0. Nevertheless, a — J is never positive 
semi-definite since the determinant is —1 < (the author wishes to thank Rob Fruend for this 
counterexample) . 

Let us now give an example of a continuous spin model for which the product in (Q is convex. 
Such an example can derived as a continuous analogue of the coloring model with countably 
infinitely many colors. In particular we let K = 2. Fix a countable sequence of mutually disjoint 
positive Lebesgue measure sets A r C R, r > 1, and positive weights 7 r > 0,r > 1 such that 
sup7 r < 00. Fix any 7 > sup7 r and define 



J(x,y) =7-^7 r l{x,y G A r }. (11) 

■r>l 

Namely, for every vector (xj, 1 < % < n), the corresponding matrix is 

A = 



^7 - ^2^A{xi,Xj G A r }, 1 < i,j < rij . 



Then 7 — A is a positive semi-definite matrix since for every y G M n , 

y T ( 1 -A)y = J2lr( yrf>°- 

In the special case 7 = l,j r G {0,1} we also obtain J(x,y) G {0,1} which conforms with 
Talagrand's Conjecture [21 Thus in the special case h(x) = exp(— x 2 ) corresponding to Qh = 
in order to satisfy Assumption [1] corresponding to the existence of soft states, it suffices to have 
at least one r such that 7 r = and [0, k) C A r for some n > 0. (This requirement can be 
generalized to the case that A r contains some positive length interval or even positive measure 
set, by suitably relabeling the spin values). 
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Corollary 1. Conjecture^ holds when J(x,y) = 1 — ^ r>1 7r l{x, V G A r }, j r G {0,1} and 
there exists r and k > suc/j that j ro = and [0, k) C A ro; where A r is any countably infinite 
collection of mutually disjoint measurable subsets ofQh- 

Unfortunately, for the case when K = 2 potentials J are zero-one valued, the example above 
is the only form which can make a — J positive semi-definite for some a. Indeed, suppose J 
is zero-one valued deterministic edge potential such that the product ([9]) is convex for every 
xi,...,x r G M. n . Let A be the set of x such that the measure of the set {y : J(x,y) = 0} is 
non-zero. We claim that J(x, x) = for every x G Aq. Indeed, otherwise there is x' such that 
J(x, x 1 ) = 0. Then for the vector (xi, x 2 ) = (x, x') and every a > 1, the matrix a — J is 

/ a — J(x, x) a — J(x, x') \ _ f a ~ 1 « \ 

\a — J(x,x') a — J(x',x') J I a a — J(x',x') J' 

The entry a — J(x', x') is either a or a — 1. As a result the determinant of the matrix is at most 
—a 2 < 0, and thus the matrix is not positive semi-definite, and the claim is established. 

If Ao is zero measure set, then we can take A\ = Qh and the assertion is established. Otherwise 
define equivalency relation on Aq as follows: x, y G Aq are equivalent if J(x,y) = 0. The 
reflexivity follows from the observation above that J(x, x) = for every x G A , and symmetry 
follows from symmetry of J. For transitivity, suppose there exists Xi,X2,x^ G A such that 
J(xi,x 2 ) = J(x 2 ,x 3 ) = 0, but J(xi,x 3 ) = 1. Then the matrix (a — J(xi,Xj), 1 < i, j < 3) is 

a a a — 1 \ 
a a a , 
a — 1 a a J 

which is not positive semi-definite, since the determinant of this matrix is —a. This establishes 
transitivity. By the equivalency relationship, we have A = U r >iv4 r where A r are mutually 
disjoint positive measure sets, and almost surely J(x, y) — if and only if x, y G A r for some 
r > 1. Thus indeed J can satisfy the assumptions of Theorem [1] only when it is of the form (fTT|) . 

Now let us turn to the examples when K > 3. We begin with the random K-SAT model. 
Recall that for this model J takes values 1 or exp(— (3). Assumption [1] holds for this model. 
We set a = 1 and claim that the assumptions of Theorem [JJ hold as well. We fix an arbitrary 
sequence r elements: n ) G {0, l} n , I — 1,2, ... ,r. Fix also a realization of J, and 

let z[ , . . . , z* K G {0, 1} be the corresponding unique binary assignment such that J{z*, . . . , z* K ) = 
exp(— (3), and J{z\, . . . , z K ) = 1 when (zi, . . . , z K ) ^ (z\, . . . , z* K ). Consider the corresponding 
array <S>i<i< r A h where 

A l= (1- J(x l h ,...,x l iK ), l<i\,...,i l K <n). 

Every entry of the tensor product (S)i<Kr^ is conveniently indexed by a sequence 
{i\, . . . , i[), . . . , {i l K , . . . , i r K ), where i l k , 1 < I < r, 1 < k < K vary over 1, . . . , n. The correspond- 
ing entry is 

l<Kr 
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This entry is non-zero if and only if , . . . , x\ t ) = (z*, . . . , z^), in which case the value is 

(1 — exp(— P)) r . Let So C {l,...,n} be the set of indices such that for every % G So, x\ = 
x\ = ■ ■ ■ = x\. Recalling that J is generated uniformly at random, we see that the expected 
value of the entry corresponding to . . . , . . . , {i x K , . . . , i r K ) is 2~ K (1 — exp(— (3)) r if for every 
k, i\,...,i r k G 5*0, and is zero otherwise. Namely, E§Z) 1<l<r Ai is rank-1 array corresponding 
an associated principal sub-array. In particular, if S is the set of vectors . . . ,j r ) such that 
ji, . . . ,j r G Sq, then for y G , the corresponding multilinear form is 



A' 



(y,E (g) A l >= 2- K (l - exp(-(3)Y ^ y n ... h , 

^< l < r \j'i,-,>:0'i,-,jr)6S 

This form is convex since y K is a convex function on R + for every positive integer K. We have 
verified that the K-SAT model satisfies the assumptions of Theorem [U 

We now turn to the Viana-Bray model for the case when K is even. We set a = J max - For 
convenience we will use encoding —1,1 for x instead of 0,1, as it was discussed when we first 
introduced the example. In other words J{x\,X2) = exp(/3JxiX2) for any X\,X2 G { — 1,1}. We 
will use the same symmetrization trick as in [FL03] and |PT04] . For any x\, . . . ,xk G { — 1,1} 
observe that 



a - J{xi, ...,x K ) = J max - exp(£I JJ 

= Jmax - 2- 1 (exp(/3J) + exp(-/3/)) - 2- 1 (exp(/3J) - exp(-/3/)) J] 

= fl(I) ~ f2(I)U 



Xj. 



Observe also that by symmetry of the distribution of /, and as a result, of /^(-O, for every odd 
r we have 

Ef 2 (I) = 0. (12) 

Now we verify the convexity of (jUJ). Fix any sequence x l = (xi, . . . ,x n ) G {—1,1}" for I = 
1,2, ... ,r, and consider the corresponding array 1<Kr A h where 

Ai = a - J = (j max - exp(/3/4 1 • • • x \' K )i 1 < 4> • • • > 4 < 
= (/i(/)-/ 2 (/H r --^, l<i[,...,i l K <n). 

Every entry of the tensor product <S> 1<l<r A t is again conveniently indexed by a sequence 

. . . , ij), . . . , (i l K , . . . , i r K ), where i l k , 1 < I < r, 1 < k < K vary over 1, . . . , n. The correspond- 
ing entry is then 

n (/i(/)-/ 2 (/)4 i --4j= j: (fr ]s] (i)+(-h(i)f ] U^-- 

l<l<r Sc{l,...,r} \ leS 

= (i + h(i)Y+ Yl (-f^)) lsl Il x k- 

sc{i,...,r} leS 
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where the product over empty set S is assumed to be zero. Then using the observation (|T2|) the 
expected entry is 

E[(i+/i(/)n+ £ E/f^n^ 

5c{l,...,r},|5| even ZeS 

Then for any vector y = (yj 1) ...j r , 1 < Ji, - • • ,j r < n) £W 



(y,EM A l )=E K [(l + f 1 (I)Y 



KKr 



I J2 Viu~Jr I 

\l<ii, —,jr<n / 



K 



+ e e n *heIk 

Sc{l,...,r},\S\ even l<i l k <n,l<r,k<K l<k<K leS 



The first summand is a convex function since K is even. The second summand is 

K 



E E /i S| m( E *: Ik) 

[l,...,r},]5| even \l<3l.-,Jr<n ZeS / 



SC{1 

15*1 

The prefactor Eff\I) is non-negative since \S\ is restricted to be even. Finally, the remaining 
term is convex since K is even and the term inside the power K is a linear form in vector y. 

4 Preliminary technical results 

We first obtain some basic upper and lower bound on the log-partition functions. 
Lemma 2. Under the Assumption^ for every graph G with N nodes and M edges 

(M + N) log p min < log Z{G) <(M + N) log p max , (13) 
almost surely. As a result ElogZ(G)) is well defined for every graph G. 
Proof. We have 

,x u e))dx 



RJV l<u<N ee£(G) 

i { / K(x)dx 

AT J K 



< J M 

— max 



< M+7V 
— r max 



and 



Z(G) > / Y\h u (x u )T\j e (x u e } ... } x u e K )dx 

>Pmi„n / K ^ dX 



> p M+N 
— rmm 

from which ffl~3l) follows. □ 
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We now study the impact of adding/deleting one edge from a given realization of a graph 
and node and edge potentials. 

Lemma 3. Consider any graph G and realizations of node and edge potentials. Suppose the 
potential in node v G V(G) is changed from h u to h u , such that Assumption [I] is still valid. 
Denote the resulting instance by G. The following holds almost surely 

|logZ(G)-logZ(G)| < 2(l + |A/"(u,G)|)(logp max -logp min ). (14) 

Proof. Let Go be the graph obtained from G after deleting node v and all the edges in Af(v, G) 
(together with the node potential of u and edge potentials corresponding to ftf(u, G)). Applying 
Assumption [1] we have 



Z(G) = / TT/l u (x u ) I [ J e {x u e 



' ^u%* )dx 



e£E(G) 



< p!^' G)I / K(x)dx / TT/i«(^«) IT Je(x U f, ■ ■ ■ ,Xu%. )dx 



'xm N - - ujkv eeE(G)\Af(v,G) 



< pIT {v ' g)1 z(g ), 

where Z(Gq) is the partition function associated with Go: 

Z(G ) = Y\h u (x u ) ] [ J e (x u e,...,x u e K )dx. 

AeR^- 1 u ^ v e eE(G)\M(v,G) 

and where the first inequality follows since x v is not coupled anymore with x u , u ^ v through 
the edge potentials. On the other hand, applying the third part of Assumption [T] 

Z(G) > / JJ/i«(a:«) JJ J e (x u e, . . . ,x u e K )dx 

J x v £\0,k),x u £R,u^v „, 



>P 



X v £[0,K),X u £M.,U=iv u 

l+\M{v,G) 



We obtain 



|logZ(G)-logZ(G )| < (l + |A/>,G)|)(logp max -logp min ). 
Since the same bound holds for G, we obtain the required bound. □ 

Lemma 4. Consider any graph G and realizations of node and edge potentials. Suppose an edge 
e = (vi, . . . , vk) is added to the graph together with an edge potential J e satisfying Assumption^ 
Denote the resulting instance by G. The following holds almost surely 

|logZ(G + e)-logZ(G)| < (2ir + 2|Ar(e,E)| + l)(logp max -logp min ). (15) 

Proof. Consider the graph Go obtained from G by deleting nodes V\, . . . , vk and all the edges in 
Af(e, G), together with their associated node and edge potentials. From Assumption [1] we obtain 

Z(G) = / ]T/i u (x u ) TT J e (x u j, . . . ,x u ^)dx 

u 

/ FT K(X U ) T7 J e {X u e,...,X u e)dx 

Jxm N - K ,. A Trr ir* \ 



< K+\N{e,G)\ 
K+\JV{e,G)\ 



P«£ meM] Z(G ). 
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On the other hand, by the third part of Assumption [T] 

Z(G)> / IjMa^) II Je{xu\, ■ ■ ■ ,x u %)dx 

J x Vi ,...,x Vk £[0,k),x u £R,u^v 1 ,...,v k u e 

. K+\M{e,G)\ 7((p \ 
^ Pmin ^OoJ- 

We conclude 

| logZ(G) - logZ(G )| < (K + \M{e, G)|) (logp max - logp min ) . 

Observe that a similar bound holds when G + e replaces G, where we simply replace |A/"(e,G)| 
with \Af(e, G)| + 1 in upper and lower bounds. Putting the two bounds together, we obtain the 
result. □ 

We now establish a result regarding the concentration of log Z(G(N, c)) around its mean. 

Proposition 1. Under Assumption^ the following concentration bound holds: 

lim P f|A^- 1 logZ(G(A^,c)) - AT- 1 E[logZ(G(Ar,c))]| > log 3 N/Vn) =0. 

N— >oo V / 

Proof. A standard approach for proving such concentration result is Azuma-Hoeffding inequality 
which establishes concentration bound for martingales with bounded increments. The application 
of such a technique would be straightforward if we had a deterministic bound on the edge and 
node degrees Af(e, G). Unfortunately, this is not the case as the largest degree in sparse random 
graphs G( N, c) is known to grow at nearly a logarithmic rate. In order to deal with this we first 
establish a simple bound on the degree which holds with high probability and then apply the 
martingale concentration bound to a truncated version of Z(G). 

Thus let us establish the following simple bound on the largest degree of G. 

P ( max|A/(M,G)| = hgN) = N-°^ logN \ (16) 

V u<N J 

The total number of edges not containing node u is N K — (N — 1) . Thus the probability that 
a randomly chosen node contains u is 

Given an arbitrary m, we then obtain 

P(|A/-(u,G)| = m)= ( [C J J ) (| + o(N-^y (l - f + o(N~ 1 ) 

(cN) m ( K m 
< — + o(N~ m 

(cK) m ((cK)' 

= — r~ + — r 

ml \ ml 
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When m > log N, this bound is n0 (\ Ii ob n) • Using union bound, ( !T6|) follows from N 2 N °( l °s^gN) _ 
N~°( loglogN \ where factor iV in A^ 2 is obtained by over summing over nodes, and the second 
factor A" is obtained by summing over log N < m < N. 

We now return to the proof of the concentration result. For every n = 1, 2, . . . , N, let T n 
be the filtration associated with random variables h u , 1 < u < n, all edges e spanned by the 
nodes 1, . . . , n, as well as their associated random variables J e . Namely, J-" n is the information 
revealed by the portion of the graph G(N, c) associated with the first n nodes, edges spanned 
by these nodes, as well as their associated potentials h u , J e . Then Rn = logZ(G(N,c)) and 
R n = E[logZ(G(AT ) c))|J r n ],0 < n < N is a martingale, where T§ is assumed to be a trivial 
filtration and E[log Z(G(N, c))|J-o] — E[log Z(G(N, c))]. For every n, let D n be the maximum 
degree of the nodes 1, . . . , n in the subgraph spanned by 1, . . . , n. Applying Lemmas |3] and 0] 
we have \R n — R n -i\ < c.\ + c\D\, for some constant c\ > 0, which depends on K, p m i n , p ma x 
only. Indeed the conditioning on the node potential h n of the node n, by Lemma [3] changes the 
conditioned expectation by at most C\ +c 2 D n for some Ci, c 2 . Also revealing each edge incident to 
n and spanned by nodes 1, . . . , n changes the conditioned expectation also by at most C\ + c 2 -D n , 
by Lemma |H Thus the total change is at most C\ + c 2 -D 2 < c 3 _D 2 , for some appropriate constant 
C3, (where we do not bother to rename the constants c±, c 2 ). 

Let M < N be defined the smallest n such that D n > logra. If no such node exists (which 
by f|T6|) occurs with overwhelming probability), then we set M = N. Clearly, M is a stopping 
time with respect to the filtration T n , and R n = i2 m in(M,n) ) < n < N is a stopped martingale, 



satisfying \R n - R n -i\ 
every x > 0, 



< C3 log N. Now applying Azuma-Hoeffding inequality, we obtain for 



P 



Rm-ER 



N 



> x(c 3 \og 6 N)V N ) < exp(-x 2 /2). 



From this we obtain 

P (\R N -E[R N ] \ > \^N\og 3 N) < P 

< P 



R N - E[R N ] > VAHog" N,M = N)+ P(M < N) 



R N - E[R 



n 



> VN\og 3 N) + AT-o(i°gi°s^) 



< exp (- log 2 iV/(2c 2 )) + AT-odogiog v) 

_ jy-O(loglogV)^ 

We obtain the claimed concentration result: 

|A^- 1 logZ(G(A^,c)) - A^- 1 E[logZ(G(AT,c))]| > log 3 N/Vn) = N-°^° slosN \ 



□ 



5 Interpolation scheme and superadditivity 

In this section we introduce the interpolation method and use it to finish to prove our main 
result, Theorem [TJ Given a positive integer N, consider any positive integers A^i,A r 2 such that 
Nx + N 2 = N. For every t — 0,1, ... , [cN\ we introduce a random graph denoted by G(N, c, t) 
generated as follows. The graph G(N, c, t) has [cN\ edges. Among those, t edges are generated 
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independently and uniformly at random among all the N K potential edges on iV nodes. Each of 
the remaining \cN\ — t edges is generated independently and uniformly at random among the 
Ni edges of the complete graph supported by nodes 1, 2, . . . , N\, with probability N\/N, and 
is generated independently uniformly at random among the edges of the complete graph 
supported by nodes N% + 1, , . . . , N, with probability N 2 /N . Observe that G(N, c, 0) = G(N, c) 
and G(N, c, |_ C ^J) is a disjoint union of two graphs Gj,j = 1, 2, where Gj has Nj nodes and Rj 
edges chosen uniformly at random from edges, where Rj has a binomial distribution with 
\_cN\ trials and success probability Nj/N. In particular, the expected number of edges in Gj is 
(Nj/N) [cN\ G [cNj — 1, cNj}. Every node u = 1, . . . , N of the graph G(N, c, t) is equipped with 
the node potential h u distributed according to Uh, and every edge e = ei, . . . , e^j of the graph 
is equipped with the edge potential J e distributed according to uj, all choices made independent. 
Our main technical result leading to Theorem [1] is that the expected log-partition function of 
G(N, c, t) is decreasing function of t: 

Proposition 2. Suppose Assumption^ holds. Then 

E[log Z{G{N, c, t))} > E[log Z(G(N, c, t + 1))] 
for every < t < \_cN\ — 1 . 

Before we prove the proposition we use it to prove our main result. 
Proof of Theorem [3 As a corollary of Proposition [2] we obtain 

E[logZ(G(iV,c))] > E[logZ(Gi)] +E[logZ(G 2 )], (17) 

where Gi and G 2 are disjoint parts of G(N, c, L C -^J) described above. Since the expected number 
of edges of Gj,j = 1,2 is in the interval [cNj — l,cNj], and the number of edges has binomial 
distribution with O(N) trials, then we can obtain a graph G(Nj, c) from Gj by deleting or adding 
at most 0(\/ r N) edges in expectation. Applying Lemma H] this also implies that for j — 1, 2 



E[logZ(Gi)] -E[\ogZ(G(N j} c))} < O(VN). 

Combining with (fTTj) this implies that the sequence E[log Z(G(N, c))] satisfies the following near 
super-additivity property: 



E[log Z(G(N, c))] > E[log Z(G(iV!, c))] + E[log Z(G(N 2} c))] - 0(VN). 

It is a classical fact, known as Fekete's Lemma, that super-additive sequences converge to a limit 
after the normalization. It is rather straightforward to show that the same applies to nearly 
super-additive sequences, provided the correction term is 0(N a ), with a < 1 (and a = 1/2 in 
our case). The complete proof can be found in [GB GTIO] . 



We conclude that the following limit exists: 

]im E[logZ(G(iV,c))] _ 

iV-s-oo 

Combining with the concentration result of Proposition (TJ we conclude that the sequence G(N, c) 
is right-converging. □ 
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Proof of Proposition Fix any t < \_cN\ . Observe that the graph G(N, c, t + 1) can be obtained 
from G(N, c, t) by removing from G(N, c, t) an edge e (together with the associated edge poten- 
tial) chosen uniformly at random from all the edges of G(N, c, t), and adding an edge e supported 
by nodes 1, . . .,N\ chosen uniformly at random from possibilities, with probability Ni/N, 
or supported by nodes N\ + 1, . . . , N chosen uniformly at random from N 2 possibilities, with 
probability N 2 /N. The newly created edge e is equipped with an edge potential Jg generated 
at random using uj, independently from all the other randomness of the graph. In this edge 
removing and edge adding procedure we keep the node potentials intact. Similarly, we keep 
edge potentials intact for all edges other than the removed and the added one. Let Go be the 
realization of the graph obtained after removing edge e, but before adding e. We assume that 
Go encodes the node/edge potentials as well. Our proposition will follow from the following 
inequality which we claim holds for every Go: 

E[log Z(G(N, c, t))\G ] - log Z(G ) > E[log Z(G(N, c, t + 1)) |G ] - log Z(G ). (18) 

Note by Lemma [2] that log Z(Gq) as well as both expectations are finite, and thus the proposition 
indeed follows from ( TIB"]) . Let e = (v%, . . . , Vr) and let J be the corresponding edge potential. 
Similarly, let e = (vi, . . . ,vk) and let J be the corresponding edge potential. Notice that the 
randomness of e, e, J and J are the only sources of randomness in the expectations in (TT8"j) . 
Considering a > J max such that ()9]) is convex, we use Taylor expansion 

logx — logxo = — _1 (^o — x) r XQ r 

r>l 

around xq = aZ (Go), we obtain 

E[\ogZ(G(N, c, t))\G , J] - logZ(Go) 

= log a - r~ 1 a _r ^ _r (Go)E [(aZ(G ) - Z{G{N, c, t))) r ] . 

r>l 

Before we proceed, we need to justify the interchange of infinite summation and expectation. First 
observe that aZ(G ) > Z(G(N,c,t)), since adding an edge can increase the partition function 
by at most J max < a multiplicative factor. (Bound in Lemma H] is cruder since we needed it to be 
two sided). Then the interchange of limits is justified by the Monotone Convergence Theorem. 
With a similar expression for Z(G(N, c,t + 1)), we obtain that it suffices to show 

E [(aZ(G ) - Z(G(N, c, t))) r ] < E [(aZ(G ) - Z(G(N, c, t + l))) r ] . (19) 
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We begin with the expression on the left and expand it as 
E[(aZ(G )-Z(G(N,c,t))) r } 



E 



E 



(/ {ot J( y x Vl , . . . , x VK )) J^J h u ( y x u ) | j J e (x u e , . . . , x u <^)d, 
jRN u eei?(Go) 

! I (a-J(a? Vl ,...,x l VK ))Y[h u (x l J 



x 1 ,...,x'-ek" 1<Kr 



X II J e(x l u t ),---,X l u - k )dx 1 ---dx 

eGE(Go) 



KKr 



l<«i,...t)jr<JV ' 

X 1 f Je(. x u\i ■ ■ ■ ' ^ul-)^ ' ' ' ^ • 
eeB(Go) 



Here we note that the expectation in the last term is with respect to the randomness of J only. 

(20) 



Given x 1 , . . . , x r , we focus on 



• v_/v e e n (^-j(x i vl ,...,x i VK )). 

l<V!,...v K <N l<l<r 



For each I = 1, . . . , r, consider the i^-th order iV-dimensional array 

A = (a- J(x l Vl ,...,x l VK ),l< v h ...,v K < N) . 
Also consider A^-dimensional vector e N ' r defined as follows: for every 1 < ii, . . . , i r < N, 



N-\ l 1 = l 2 



N,r 

l 0, otherwise. 



Now observe that (1201) is 



E 



(8) 4> 



KKr 



Now consider the right-hand size of ( 1191) . For convenience, denote the set of nodes 1, . . . ,N± 
by [JVi], and the set of nodes N± + 1, . . . , N by [N 2 ]. Using the same expansion, but keeping in 
mind that we have e in place of e, we obtain 



AT l 



J2 [ e[k«-j« ) ...,4))[Im<) 



i=i,2 " ' i<vi,...v K e[Nj] 
x II ^(^.■■■.^ Sf )ds 1 ---da; r . 

e£E(Go) 



KKr 
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Given x 1 , . . . , x r , we now focus on 



E f N i K E E n («• - J « 

J=l,2 l<-ui,...t) A -e[Afj] l<Kr 



«1 j • • • j Wjf 



(21) 



For each j = 1,2 consider iV r - dimensional vector e N,r ^ defined as follows: for every 1 < 
i u ...,i r <N, 



p N,r,j 



Nr\ if i 1 = i 2 = 
0, otherwise. 



Now observe that (!20l) is 



> — E 



3=1,2 



KKr 



where A;, 1 < / < r are defined as above. By the assumption of convexity of the expected tensor 
product E[(£) 1<l<r Ai], which is (jHJ), we obtain 



> — E 



i=i,2 



(e N ^, (9) A,) 



KKr 



> E 



3=1,2 



KKr 



Recognizing Yjj=i 2 -j^ eN ' r ^ as eN ' r we obtain the claimed bound ( 1T9"|) . This completes the proof 
of Proposition |2j □ 
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